Skip to main content

Batch Data Integration - Introduction

Overview​

Batch integration allows you to receive Dataoris geolocation event data in structured files delivered periodically to your AWS S3 bucket.

What is Batch Integration?​

Instead of receiving events in real-time via MQTT or Webhook, batch integration delivers periodic files containing aggregated event data. This is ideal for:

  • Historical analysis of geolocation patterns
  • Data warehousing and business intelligence
  • Periodic reporting on user movement patterns
  • Offline processing of large volumes of event data

Data Format​

Batch files use the same event structure as MQTT messages. For complete field descriptions, see:

File Formats​

You can choose between:

  • CSV: Standard comma-separated values (recommended for Dataoris)
  • Parquet: Compressed columnar format

Next Steps​

  1. Authentication with Swagger: Set up API authentication
  2. Authentication with cURL: Alternative authentication method
  3. AWS S3 Bucket Setup: Configure your S3 bucket
  4. CSV File Examples: See example CSV files with Dataoris data

Support​

For questions about batch integration: